Image processing apparatus and image processing method

ABSTRACT

Discussed is an image display device which detects image characteristic information from an image of a screen provided by a mobile terminal, extracts a characteristic area based on the image characteristic information, and automatically magnifies or reduces the extracted characteristic area and display the same, to thereby allow a user to conveniently and effectively view the image provided from the mobile terminal in a vehicle. The image display device includes: a communication unit configured to receive an image from a mobile terminal; a controller configured to detect image characteristic information of the received image, extract a first area on the basis of the detected image characteristic information, determine an image processing scheme with respect to the extracted first area, and process an image corresponding to the extracted first area according to the determined image processing scheme; and a display unit configured to display the processed image.

CROSS REFERENCE TO RELATED APPLICATIONS

Pursuant to 35 U.S.C. §119(a)-(e), this application claims the benefitof U.S. Provisional Application No. 61/467,699, filed on Mar. 25, 2011,the entire contents of which is hereby incorporated by reference in itsentirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present disclosure relates to an electronic device and, moreparticularly, to a method for processing images in an image displaydevice mounted in a vehicle, and an image display device and a mobileterminal providing the same.

2. Description of the Related Art

An image display device has a function of outputting images for users toview. Users may view images in a vehicle through the image displaydevice mounted in the vehicle. The image display device mounted in thevehicle is able to receive images from an external device such as amobile terminal in the vehicle through a fixed line or wirelessly toallow a user to view the received images.

SUMMARY OF THE INVENTION

Accordingly, an aspect of the present disclosure provides an imagedisplay device capable of detecting image characteristic informationfrom an image of a screen provided by a mobile terminal, extracting acharacteristic area based on the image characteristic information, andautomatically magnifying or reducing the extracted characteristic areaand display the same, to thereby allow a user to conveniently andeffectively view the image provided from the mobile terminal in avehicle.

Another object of the present disclosure is to provide an image displaydevice capable of changing an image subject to a travel regulationaccording to the speed of a vehicle, to thus allow the user not to beinterfered with while driving.

To achieve these and other advantages and in accordance with the purposeof the present disclosure, as embodied and broadly described herein, anembodiment of the present disclosure provides in one aspect an imagedisplay device including: a communication unit configured to receive animage from a mobile terminal; a controller configured to detect imagecharacteristic information of the received image, extract a first areaon the basis of the detected image characteristic information, determinean image processing scheme with respect to the extracted first area, andprocess an image corresponding to the extracted first area according tothe determined image processing scheme; and a display unit configured todisplay the processed image.

The controller may determine whether or not a state of the vehiclecorresponds with travel regulation conditions, and when the state of thevehicle corresponds with the travel regulation conditions, thecontroller may process the image corresponding to the first areaaccording to the determined image processing scheme.

When the image characteristic information corresponding to the extractedfirst area is a moving image (or a streaming moving image), the imageprocessing scheme may be a scheme of magnifying or reducing the imagecorresponding to the first area.

When the image characteristic information corresponding to the extractedfirst area is a moving image, the image processing scheme may be ascheme of changing the image corresponding to the first area into animage having a predetermined resolution.

The image processing scheme may be a scheme of receiving an image whichhas been magnified or reduced to a predetermined size from the mobileterminal.

The image processing scheme may be a scheme of receiving an imagechanged to have predetermined resolution from the mobile terminal.

The image processing scheme may be a scheme of displaying a substituteimage on a first area when the image characteristic informationcorresponding to the extracted first area is a moving image.

The image processing scheme may be a scheme of requesting a continuoustransmission of the image corresponding to the first area and receivingthe image corresponding to the request from the mobile terminal.

The image processing scheme may be a scheme of requesting aninterruption of a transmission of an image corresponding to a secondarea except for the first area of the received image from the mobileterminal, storing the second area, and processing the imagecorresponding to the first area and an image corresponding to the storedsecond area so as to be displayed on the display unit.

When the image characteristic information corresponding to the extractedfirst area is text, the controller may extract the size of the text andcompare the size of the text with a reference size, and when the size ofthe text is smaller than the reference size, the controller may providecontrol to magnify and display the first area.

To achieve these and other advantages and in accordance with the purposeof the present disclosure, as embodied and broadly described herein, anembodiment of the present disclosure provides in another aspect a mobileterminal including: a communication unit configured to receive anincoming call; and a controller configured to determine whether or notthe mobile terminal has been connected to an image display devicemounted in a vehicle according to the reception of the incoming call,and provide control to continuously execute an application which hasbeen executed when the mobile terminal has been connected to the imagedisplay device mounted in the vehicle.

The controller may provide control to transmit a signal indicating thatthe incoming call has been received to the image display device mountedin the vehicle.

To achieve these and other advantages and in accordance with the purposeof the present disclosure, as embodied and broadly described herein, anembodiment of the present disclosure provides in another aspect an imagedisplay device mounted in a vehicle including: a communication unitconfigured to receive an image from a mobile terminal; a controllerconfigured to determine whether or not an application corresponding tothe received image is a travel regulation target; and a display unitconfigured to display an image substituting the received image when theapplication corresponding to the received image is a travel regulationtarget.

The controller may extract image characteristic information from thereceived image, and determine whether or not an applicationcorresponding to the received image is a travel regulation target on thebasis of the extracted image characteristic information and aclassification model.

The controller may determine whether or not a state of the vehiclecorresponds with travel regulation conditions, and the display unit maydisplay an image replacing the received image, when the state of thevehicle corresponds with travel regulation conditions.

The travel regulation conditions may be that the speed of the vehicle ishigher than a predetermined speed.

To achieve these and other advantages and in accordance with the purposeof the present disclosure, as embodied and broadly described herein, anembodiment of the present disclosure provides in another aspect adisplay method including: receiving an image from a mobile terminal;detecting image characteristic information of the received image;extracting a first area on the basis of the detected imagecharacteristic information; determining an image processing scheme withrespect to the extracted first area on the basis of the imagecharacteristic information corresponding to the extracted first area;processing an image corresponding to the extracted first area on thebasis of the determined image processing scheme; and displaying theprocessed image.

To achieve these and other advantages and in accordance with the purposeof the present disclosure, as embodied and broadly described herein, anembodiment of the present disclosure provides in another aspect a methodfor controlling a mobile terminal including: receiving an incoming call;determining whether or not the mobile terminal has been connected to animage display device mounted in the vehicle according to the receptionof the incoming call; and when the mobile terminal has been connected tothe image display device mounted in the vehicle, providing control tocontinuously execute an application which has been executed.

To achieve these and other advantages and in accordance with the purposeof the present disclosure, as embodied and broadly described herein, anembodiment of the present disclosure provides in another aspect adisplay method including: receiving an image from a mobile terminal;determining whether or not an application corresponding to the receivedimage is a travel regulation target; and when the applicationcorresponding to the received image is a travel regulation target;displaying an image replacing the received image.

The determining of whether or not the application corresponding to thereceived image is a travel regulation target may include: extractingimage characteristic information from the received image; anddetermining whether or not the application corresponding to the receivedimage is a travel regulation target on the basis of the extracted imagecharacteristic information and a classification model.

Further scope of applicability of the present disclosure will becomeapparent from the detailed description given hereinafter. However, itshould be understood that the detailed description and specificexamples, while indicating preferred embodiments of the invention, aregiven by illustration only, since various changes and modificationswithin the spirit and scope of the invention will become apparent tothose skilled in the art from this detailed description.

BRIEF DESCRIPTION OF THE DRAWINGS

The present disclosure will become more fully understood from thedetailed description given hereinbelow and the accompanying drawings,which are given by illustration only, and thus are not limitative of thepresent disclosure, and wherein:

FIG. 1 is a view schematically showing an example of an imagetransmission system including a mobile terminal and an image displaydevice according to an exemplary embodiment of the present disclosure;

FIG. 2 is a schematic block diagram showing the configuration of amobile terminal according to an exemplary embodiment of the presentdisclosure;

FIG. 3 is a block diagram showing an image display device according toan exemplary embodiment of the present disclosure;

FIG. 4A is a schematic block diagram of the image display deviceaccording to an exemplary embodiment of the present disclosure;

FIG. 4B is a flow chart illustrating the process of controlling anoperation of the image display device according to an exemplaryembodiment of the present disclosure;

FIG. 5A is a view showing the process of controlling an operation of theimage display device according to a first exemplary embodiment of thepresent disclosure;

FIGS. 5B and 5C are flow charts illustrating the process of controllingan operation of the image display device according to the firstexemplary embodiment of the present disclosure;

FIG. 6 is a flow chart illustrating the process of controlling anoperation of the image display device according to a second exemplaryembodiment of the present disclosure;

FIG. 7A is a view showing a process of controlling an operation of theimage display device according to a third exemplary embodiment of thepresent disclosure;

FIG. 7B is a flow chart illustrating the process of controlling anoperation of the image display device according to the third exemplaryembodiment of the present disclosure;

FIG. 8A is a view showing a process of controlling an operation of theimage display device according to a fourth exemplary embodiment of thepresent disclosure;

FIG. 8B is a flow chart illustrating the process of controlling anoperation of the image display device according to the fourth exemplaryembodiment of the present disclosure;

FIG. 9 is a view showing a process of controlling an operation of theimage display device according to a fifth exemplary embodiment of thepresent disclosure; and

FIG. 10 is a flow chart illustrating the process of controlling anoperation of the image display device according to a sixth exemplaryembodiment of the present disclosure.

DETAILED DESCRIPTION OF THE INVENTION

Reference will now be made in detail to the preferred embodiments of thepresent disclosure, examples of which are illustrated in theaccompanying drawings. In the following description, usage of suffixessuch as ‘module’, ‘part’ or ‘unit’ used for referring to elements isgiven merely to facilitate explanation of the present disclosure,without having any significant meaning by itself.

The present disclosure will now be described more fully hereinafter withreference to the accompanying drawings, in which preferred embodimentsof the invention are shown. This invention may, however, be embodied inmany different forms and should not be construed as being limited to theembodiments set forth herein.

The terminology used herein is for the purpose of describing particularembodiments only and is not intended to be limiting of the invention.Unless otherwise defined, all terms used herein have the same meaning ascommonly understood by one of ordinary skill in the art to which thisinvention pertains, and should not be interpreted as having anexcessively comprehensive meaning or as having an excessively contractedmeaning. If technical terms used herein is erroneous that fails toaccurately express the technical idea of the present disclosure,erroneous terms should be replaced with technical terms that allow theperson in the art to properly understand. The general terms used hereinshould be interpreted according to the definitions in the dictionary orin the context and should not be interpreted as an excessivelycontracted meaning.

Image Transmission System

FIG. 1 is a view schematically showing an example of an imagetransmission system including a mobile terminal and an image displaydevice according to an exemplary embodiment of the present disclosure.

As shown in FIG. 1, the image transmission system according to anexemplary embodiment of the present disclosure includes a mobileterminal 100 and an image display device 200.

The mobile terminal 100 may be connected to the image display device 200through a fixed line or wirelessly to transmit at least one of an imageand a voice to the image display device 200.

The image display device 200 may be mounted in a vehicle in a fixedmanner, and may be connected to the mobile terminal 100 through a fixedline or wirelessly to receive at least one of an image and a voice fromthe mobile terminal. Also, the image display device 200 may output atleast one of the image and voice which has been received from the mobileterminal.

The image display device 200 may receive a user input and transmit thereceived input to the mobile terminal 100. For example, when the userapplies a touch input through a touch screen provided to the imagedisplay device 200, a position of a point to which the touch input hasbeen applied in the image is recognized, the information regarding therecognized position may be transmitted to the mobile terminal 100.

Then, the mobile terminal 100 may determine that a touch event hasoccurred at the point at which the touch input has been applied, and mayperform an operation corresponding to the generated touch event. Namely,the user may control the operation of the mobile terminal 100 by using atouch screen, a hard key, or the like provided to the image displaydevice 200.

In an embodiment of the image transmission system, the user may executea road guide application (or dialing, a phone book, an e-mail, a movingimage play application, and the like) installed in the mobile terminal100 and the mobile terminal transmits an executed image of the roadguide application to the image display device 200 so that the executedimage of the road guide application can be displayed on the imagedisplay device 200.

The user can view the executed image of the road guide application on alarge screen of the image display device 200 in the place of a smallscreen of the mobile terminal 100. Also, the user can listen to a roadguide voice through a speaker provided to the vehicle in the place of aspeaker of the mobile terminal 100.

Also, when the user selects a menu related to the road guide by using atouch screen or a hard key provided to the image display device 200, anoperation with respect to the corresponding menu can be performed on themobile terminal 100. The mobile terminal may transmit the results ofperforming the operation with respect to the corresponding menu to theimage display device 200 so that the image display device 200 can outputthe same.

The mobile terminal 100 and the image display device 200 may beconnected by using a short-distance communication standard such asBluetooth™, or the like, a wireless Internet standard such as Wi-Fi, orthe like, an external device interface standard, such as USB (UniversalSerial Bus), or the like.

Also, a server application providing a service may be installed in themobile terminal 100 and a client application allowing for a connectionto a service provided by the server may be installed in the imagedisplay device 200 according to a client's request.

The server application of the mobile terminal 100 may capture an imageof the screen of the mobile terminal regardless of an application typeof the mobile terminal 100 and transmit the captured image to the clientapplication of the image display device 200. Also, the serverapplication controls the operation of the mobile terminal 100 on thebasis of information regarding an event generated in the image displaydevice 200 from the client application.

For example, the image display device 200 may remotely control themobile terminal 100 according to a VNC (Virtual Network Computing)scheme using an RFB (Remote Frame Buffer) protocol providing a remoteaccess to a graphic user interface. According to the VNC scheme, whilethe mobile terminal 100 is transferring screen update to the imagedisplay device, an input event generated by the image display device 200is transmitted to the mobile terminal 100.

Also, the mobile terminal 100 may transit a voice to the image displaydevice 200, a headset, a hands free, or the like, according to, forexample, an A2DP (Advanced Audio Distribution Profile) defining soundquality of an audio (stereo or mono) signal or output which can bestreamed from a first device to a second device, an HSP (HeadSetProfile) regarding a Bluetooth headset, an HFP (HandsFree Profile)applied to a vehicle hands free kit, or the like.

Meanwhile, the mobile terminal 100 and the image display device 200 mayexchange supplementary information on the basis of a protocol. Forexample, the image display device 200 may provide vehicle statusinformation such as vehicle travel information, speed information, fuelinformation, or the like, to the mobile terminal 100.

Some applications installed in the mobile terminal 100 may use thevehicle status information received from the image display device 200 byusing a protocol. Also, the applications may provide informationregarding the type of applications (e.g., a road guidance, multimedia,games, and the like), the type of a GUI (Graphic User Interface), thestatus of an application (e.g., whether or not an application is beingexecuted at a foreground or a background), or the like.

Mobile Terminal

FIG. 2 is a schematic block diagram showing the configuration of amobile terminal according to an exemplary embodiment of the presentdisclosure. The mobile terminal 100 may be implemented in various forms.For example, the mobile terminal may include mobile phones, smartphones,notebook computers, digital broadcast terminals, PDAs (Personal DigitalAssistants), PMPs (Portable Multimedia Player), etc.

As shown in FIG. 2, the mobile terminal 100 may include a wirelesscommunication unit 110, an A/V (Audio/Moving image) input unit 120, auser input unit 130, a sensing unit 140, an output unit 150, a memory160, an interface unit 170, a controller 180, and a power supply unit190, etc. The components as shown in FIG. 1 are not a requirement, andgreater or fewer components may alternatively be implemented.

The wireless communication unit 110 may include one or more componentsallowing the mobile terminal 100 and a wireless communication system toperform radio communication or the mobile terminal 100 and a network inwhich the mobile terminal 100 is located to perform radio communication.For example, the wireless communication unit 110 may include a broadcastreceiving module 111, a mobile communication module 112, a wirelessInternet module 113, a short-range communication module 114, and alocation information module 115.

The broadcast receiving module 111 receives broadcast signals and/orbroadcast associated information from an external broadcast managementserver (or other network entity) via a broadcast channel. The broadcastchannel may include a satellite channel and/or a terrestrial channel.The broadcast management server may be a server that generates andtransmits a broadcast signal and/or broadcast associated information ora server that receives a previously generated broadcast signal and/orbroadcast associated information and transmits the same to a terminal.The broadcast signal may include a TV broadcast signal, a radiobroadcast signal, a data broadcast signal, and the like. Also, thebroadcast signal may further include a broadcast signal combined with aTV or radio broadcast signal.

The broadcast associated information may also be provided via a mobilecommunication network and, in this case, the broadcast associatedinformation may be received by the mobile communication module 112. Thebroadcast signal may exist in various forms. For example, broadcastsignal may exist in the form of an electronic program guide (EPG) ofdigital multimedia broadcasting (DMB), electronic service guide (ESG) ofdigital moving image broadcast-handheld (DVB-H), and the like.

The broadcast receiving module 111 may be configured to receive signalsbroadcast by using various types of broadcast systems. In particular,the broadcast receiving module 111 may receive a digital broadcast byusing a digital broadcast system such as multimediabroadcasting-terrestrial (DMB-T), digital multimediabroadcasting-satellite (DMB-S), digital moving image broadcast-handheld(DVB-H), the data broadcasting system known as media forward link only(MediaFLO®), integrated services digital broadcast-terrestrial (ISDB-T),etc. The broadcast receiving module 111 may be configured to be suitablefor every broadcast system that provides a broadcast signal as well asthe above-mentioned digital broadcast systems. Broadcast signals and/orbroadcast-associated information received via the broadcast receivingmodule 111 may be stored in the memory 160 (or anther type of storagemedium).

The mobile communication module 112 transmits and/or receives radiosignals to and/or from at least one of a base station (e.g., accesspoint, Node B, etc.), an external terminal (e.g., other user devices)and a server (or other network entities). Such radio signals may includea voice call signal, a moving image call signal or various types of dataaccording to text and/or multimedia message transmission and/orreception.

The wireless Internet module 113 supports wireless Internet or othernetwork access for the mobile terminal. This module may be internally orexternally coupled to the terminal. Here, as the wireless Internettechnique, a wireless local area network (WLAN), Wi-Fi, wirelessbroadband (WiBro), world interoperability for microwave access (WiMAX),high speed downlink packet access (HSDPA), and the like, may be used.

The short-range communication module 114 is a module for supportingshort range communications. Some examples of short-range communicationtechnology include Bluetooth™, Radio Frequency IDentification (RFID),Infrared Data Association (IrDA), Ultra-WideBand (UWB), ZigBee™,Wireless LAN, and the like.

The location information module 115 is a module for checking oracquiring a location (or position) of the mobile terminal. For example,the location information module 115 may be embodied by using a GPS(Global Positioning System) module that receives location informationfrom a plurality of satellites. Here, the location information mayinclude coordinate information represented by latitude and longitudevalues. For example, the GPS module may measure an accurate time anddistance from three or more satellites, and accurately calculate acurrent location of the mobile terminal according to trigonometry basedon the measured time and distances. A method of acquiring distance andtime information from three satellites and performing error correctionwith a single satellite may be used. In particular, the GPS module mayacquire an accurate time together with three-dimensional speedinformation as well as the location of the latitude, longitude andaltitude values from the location information received from thesatellites. As the location information module 115, a Wi-Fi positionsystem and/or hybrid positioning system may be used.

The A/V input unit 120 is configured to receive an audio or moving imagesignal. The A/V input unit 120 may include a camera 121 (or other imagecapture device) and a microphone 122 (or other sound pick-up device).The camera 121 processes image data of still pictures or moving imageobtained by an image capture device in a moving image capturing mode oran image capturing mode. The processed image frames may be displayed ona display unit 151 (or other visual output device).

The image frames processed by the camera 121 may be stored in the memory160 (or other storage medium) or transmitted via the wirelesscommunication unit 110. Two or more cameras 121 may be providedaccording to the configuration of the mobile terminal.

The microphone 122 may receive sounds (audible data) via a microphone(or the like) in a phone call mode, a recording mode, a voicerecognition mode, and the like, and can process such sounds into audiodata. The processed audio (voice) data may be converted for output intoa format transmittable to a mobile communication base station (or othernetwork entity) via the mobile communication module 112 in case of thephone call mode. The microphone 122 may implement various types of noisecanceling (or suppression) algorithms to cancel (or suppress) noise orinterference generated in the course of receiving and transmitting audiosignals.

The user input unit 130 (or other user input device) may generate keyinput data from commands entered by a user to control various operationsof the mobile terminal. The user input unit 130 allows the user to entervarious types of information, and may include a keypad, a dome switch, atouch pad (e.g., a touch sensitive member that detects changes inresistance, pressure, capacitance, etc. due to being contacted) a jogwheel, a jog switch, and the like. In particular, when the touch pad isoverlaid on the display unit 151 in a layered manner, the display unit151 may be called a touch screen.

The sensing unit 140 (or other detection device) detects a currentstatus (or state) of the mobile terminal 100 such as an opened or closedstate of the mobile terminal 100, a location of the mobile terminal 100,the presence or absence of user contact with the mobile terminal 100(i.e., touch inputs), the orientation of the mobile terminal 100, anacceleration or deceleration movement and direction of the mobileterminal 100, etc., and generates commands or signals for controllingthe operation of the mobile terminal 100. For example, when the mobileterminal 100 is implemented as a slide type mobile phone, the sensingunit 140 may sense whether the slide phone is opened or closed. Inaddition, the sensing unit 140 can detect whether or not the powersupply unit 190 supplies power or whether or not the interface unit 170is coupled with an external device.

The interface unit 170 (or other connection device) serves as aninterface by which at least one external device may be connected withthe mobile communication terminal 100. For example, the external devicesmay include wired or wireless headset ports, an external power supply(or battery charger) ports, wired or wireless data ports, memory cardports, ports for connecting a device having an identification module,audio input/output (I/O) ports, moving image I/O ports, earphone ports,or the like. Here, the identification module may be a memory chip (orother element with memory or storage capabilities) that stores variousinformation for authenticating user's authority for using the mobilecommunication terminal 100 and may include a user identity module (UIM),a subscriber identity module (SIM) a universal subscriber identitymodule (USIM), and the like. In addition, the device having theidentification module (referred to as the ‘identifying device’,hereinafter) may take the form of a smart card. Accordingly, theidentifying device may be connected with the terminal 100 via a port orother connection device. The interface unit 170 may be used to receiveinputs (e.g., data, information, power, etc.) from an external deviceand transfer the received inputs to one or more elements within themobile communication terminal 100 or may be used to transfer databetween the mobile communication terminal and an external device.

The output unit 150 is configured to provide outputs in a visual,audible, and/or tactile manner (e.g., audio signal, moving image signal,alarm signal, vibration signal, etc.). The output unit 150 may includethe display unit 151, an audio output module 152, an alarm unit 153, ahaptic module 154, and the like.

The display unit 151 may display information processed in the mobileterminal 100. For example, when the mobile terminal 100 is in a phonecall mode, the display unit 151 may display a User Interface (UI) or aGraphic User Interface (GUI) associated with a call or othercommunication (such as text messaging, multimedia file downloading,etc.). When the mobile terminal 100 is in a moving image call mode orimage capturing mode, the display unit 151 may display a captured imageand/or received image, a UI or GUI that shows moving images or imagesand functions related thereto, and the like.

The display unit 151 may include at least one of a Liquid CrystalDisplay (LCD), a Thin Film Transistor-LCD (TFT-LCD), an Organic LightEmitting Diode (OLED) display, a flexible display, a three-dimensional(3D) display, or the like. The mobile terminal 100 may include two ormore display units (or other display device) according to its particulardesired embodiment. For example, the mobile terminal may include both anexternal display unit (not shown) and an internal display unit (notshown).

Meanwhile, when the display unit 151 and the touch pad are overlaid in alayered manner to form a touch screen, the display unit 151 may functionas both an input device and an output device. The touch sensor may havethe form of, for example, a touch film, a touch sheet, a touch pad, andthe like.

Also, the touch sensor may be configured to convert the pressure appliedto a particular portion of the display unit 151 or a change incapacitance generated at a particular portion of the display unit 151into an electrical input signal. The touch sensor may be configured todetect a touch input pressure as well as a touch input position and atouch input area. When there is a touch input with respect to the touchsensor, the corresponding signal(s) are sent to a touch controller (notshown). The touch controller processes the signal(s) and transmitscorresponding data to the controller 180. Accordingly, the controller180 can recognize a touched region of the display unit 151.

The proximity sensor 141 may be may be disposed within the mobileterminal covered by the touch screen or near the touch screen. Theproximity sensor 141 refers to a sensor for detecting the presence orabsence of an object that accesses a certain detect surface or an objectthat exists nearby by using the force of electromagnetism or infraredrays without a mechanical contact. Thus, the proximity sensor 141 has alonger life span compared with a contact type sensor, and the proximitysensor 141 can be utilized for various purposes.

The proximity sensor 141 may include, for example, a transmission typephoto sensor, a direct reflection type photo sensor, a mirror-reflectiontype photo sensor, an RF oscillation type proximity sensor, acapacitance type proximity sensor, a magnetic proximity sensor, aninfrared proximity sensor. When the touch screen is an electrostatictype touch screen, an approach of the pointer is detected based on achange in an electric field according to the approach of the pointer. Inthis case, the touch screen (touch sensor) may be classified as aproximity sensor.

In the following description, for the sake of brevity, recognition ofthe pointer positioned to be close to the touch screen without beingcontacted will be called a ‘proximity touch’, while recognition ofactual contacting of the pointer on the touch screen will be called a‘contact touch’. In this case, when the pointer is in the state of theproximity touch, proximity touch means that the pointer is positioned tocorrespond vertically to the touch screen.

The proximity sensor 141 detects a proximity touch and a proximity touchpattern (e.g., a proximity touch distance, a proximity touch speed, aproximity touch time, a proximity touch position, a proximity touchmovement state, or the like), and information corresponding to thedetected proximity touch operation and the proximity touch pattern canbe outputted to the touch screen.

The audio output module 152 may output audio data received from thewireless communication unit 110 or stored in the memory 160 in a callsignal reception mode, a call mode, a record mode, a voice recognitionmode, a broadcast reception mode, and the like. Also, the audio outputmodule 152 may provide audible outputs related to a particular function(e.g., a call signal reception sound, a message reception sound, etc.)performed in the mobile terminal 100. The audio output module 152 mayinclude a receiver, a speaker, a buzzer, etc.

The alarm unit 153 outputs a signal for informing about an occurrence ofan event of the mobile terminal 100. Events generated in the mobileterminal may include call signal reception, message reception, keysignal inputs, and the like. In addition to moving image or audiosignals, the alarm unit 153 may output signals in a different manner,for example, to inform about an occurrence of an event. For example, thealarm unit 153 may output a signal in the form of vibration. When a callsignal is received or a message is received, the alarm unit 153 mayvibrate the mobile terminal through a vibration device. Or, when a keysignal is inputted, the alarm unit 153 may vibrate the mobile terminal100 through a vibration device as a feedback with respect to the keysignal input. Through the vibration, the user may recognize theoccurrence of an event. A signal for notifying about the occurrence ofan event may be output to the display unit 151 or to the voice outputmodule 152.

The haptic module 154 generates various tactile effects the user mayfeel. A typical example of the tactile effects generated by the hapticmodule 154 is vibration. The strength and pattern of the haptic module154 can be controlled. For example, different vibrations may be combinedto be outputted or sequentially outputted.

Besides vibration, the haptic module 154 may generate various othertactile effects such as an effect by stimulation such as a pinarrangement vertically moving with respect to a contact skin, a sprayforce or suction force of air through a jet orifice or a suctionopening, a contact on the skin, a contact of an electrode, electrostaticforce, etc., an effect by reproducing the sense of cold and warmth usingan element that can absorb or generate heat.

The haptic module 154 may be implemented to allow the user to feel atactile effect through a muscle sensation such as fingers or arm of theuser, as well as transferring the tactile effect through a directcontact. Two or more haptic modules 154 may be provided according to theconfiguration of the mobile terminal 100. The haptic module 154 may beprovided to a place which is frequently in contact with the user. Forexample, the haptic module 154 may be provided to a steering wheel, agearshift, a lever, a seat, and the like.

The memory 160 may store software programs used for the processing andcontrolling operations performed by the controller 180, or maytemporarily store data (e.g., a map data, phonebook, messages, stillimages, moving image, etc.) that are inputted or outputted.

The memory 160 may include at least one type of storage medium includinga Flash memory, a hard disk, a multimedia card micro type, a card-typememory (e.g., SD or DX memory, etc), a Random Access Memory (RAM), aStatic Random Access Memory (SRAM), a Read-Only Memory (ROM), anElectrically Erasable Programmable Read-Only Memory (EEPROM), aProgrammable Read-Only memory (PROM), a magnetic memory, a magneticdisk, and an optical disk. Also, the mobile terminal 100 may be operatedin relation to a web storage device that performs the storage functionof the memory 160 over the Internet.

The interface unit 170 serves as an interface with every external deviceconnected with the mobile terminal 100. For example, the externaldevices may transmit data to an external device, receives and transmitspower to each element of the mobile terminal 100, or transmits internaldata of the mobile terminal 100 to an external device. For example, theinterface unit 170 may include wired or wireless headset ports, externalpower supply ports, wired or wireless data ports, memory card ports,ports for connecting a device having an identification module, audioinput/output (I/O) ports, moving image I/O ports, earphone ports, or thelike. Here, the identification module may be a chip that stores variousinformation for authenticating the authority of using the mobileterminal 100 and may include a user identity module (UIM), a subscriberidentity module (SIM) a universal subscriber identity module (USIM), andthe like. In addition, the device having the identification module(referred to as ‘identifying device’, hereinafter) may take the form ofa smart card. Accordingly, the identifying device may be connected withthe terminal 100 via a port. The interface unit 170 may be used toreceive inputs (e.g., data, information, power, etc.) from an externaldevice and transfer the received inputs to one or more elements withinthe mobile terminal 100 or may be used to transfer data between themobile terminal and an external device.

When the mobile terminal 100 is connected with an external cradle, theinterface unit 170 may serve as a passage to allow power from the cradleto be supplied there through to the mobile terminal 100 or may serve asa passage to allow various command signals inputted by the user from thecradle to be transferred to the mobile terminal there through. Variouscommand signals or power inputted from the cradle may operate as signalsfor recognizing that the mobile terminal is properly mounted on thecradle.

The controller 180 typically controls the general operations of themobile terminal. For example, the controller 180 performs controllingand processing associated with voice calls, data communications, movingimage calls, and the like. The controller 180 may include a multimediamodule 181 for reproducing multimedia data. The multimedia module 181may be configured within the controller 180 or may be configured to beseparated from the controller 180. The controller 180 may also include anavigation session 182 for controlling navigation functions, asdiscussed below relative to FIG. 3.

The controller 180 may perform a pattern recognition processing torecognize a handwriting input or a picture drawing input performed onthe touch screen as characters or images, respectively.

The power supply unit 190 receives external power or internal power andsupplies appropriate power required for operating respective elementsand components under the control of the controller 180.

Various embodiments described herein may be implemented in acomputer-readable or its similar medium using, for example, software,hardware, or any combination thereof.

For hardware implementation, the embodiments described herein may beimplemented by using at least one of application specific integratedcircuits (ASICs), digital signal processors (DSPs), digital signalprocessing devices (DSPDs), programmable logic devices (PLDs), fieldprogrammable gate arrays (FPGAs), processors, controllers,micro-controllers, microprocessors, electronic units designed to performthe functions described herein. In some cases, such embodiments may beimplemented by the controller 180 itself. For software implementation,the embodiments such as procedures or functions described herein may beimplemented by separate software modules. Each software module mayperform one or more functions or operations described herein. Softwarecodes can be implemented by a software application written in anysuitable programming language. The software codes may be stored in thememory 160 and executed by the controller 180.

Image Display Device

FIG. 3 is a block diagram showing the image display device 200 accordingto an exemplary embodiment of the present disclosure.

As shown in FIG. 3, the image display device 200 includes a main board210 including a CPU (Central Processing Unit) 212 for controlling ageneral operation of the image display device 200, a memory 213 forstoring a processing and controlling program and input and output data,a key controller 211 for controlling various key signals, and an LCDcontroller 214 for controlling an LCD.

The memory 213 stores map information (map data) for displaying roadguidance information on a digital map. Also, the memory 213 stores atraffic information collecting control algorithm for inputting trafficinformation according to the situation of a road along which the vehiclecurrently travels (runs), and information for controlling the algorithm.

The main board 210 includes or interfaces with a CDMA module 206, havinga unique device number assigned to a mobile terminal installed in avehicle, a GPS module 207 for guiding the location of the vehicle,receiving a GPS signal for tracking a travel route from a start point toa destination, or transmitting traffic information collected by the useras a GPS signal, a CD deck 208 for reproducing a signal recorded in a CD(Compact Disk), a gyro sensor 209, or the like. The CDMA module 206 andthe GPS module 207 receive signals via antennas 204 and 205.

A broadcast receiving module 222 may be connected with the main board210 and receive a broadcast signal via an antenna 223. A display unit(i.e., an LCD) 201 under the control of the LCD controller 214, a frontboard 202 under the control of the key controller 211, and a camera 227for capturing images of the interior and/or the exterior of the vehicleare connected to the main board 210 via an interface board 203. Thedisplay unit 201 displays various moving image signals and charactersignals, and the front board 202 includes buttons for various key signalinputs and provides a key signal corresponding to a button selected bythe user to the main board 210. Also, the display unit 201 includes aproximity sensor and a touch sensor (touch screen) of FIG. 2.

The front board 202 includes a menu key for directly inputting trafficinformation. The menu key may be configured to be controlled by the keycontroller 211.

The audio board 217 is connected with the main board 210 and processesvarious audio signals. The audio board 217 includes a microcomputer 219for controlling the audio board 217, a tuner 218 for receiving a radiosignal, a power source unit 216 for supplying power to the microcomputer219, and a signal processing unit 215 for processing various voicesignals.

The audio board 217 also includes a radio antenna 220 for receiving aradio signal and a tape deck 221 for reproducing an audio tape. Theaudio board 217 may further include a voice output unit (e.g., anamplifier) 226 for outputting a voice signal processed by the audioboard 217.

The voice output unit (amplifier) 226 is connected to a vehicleinterface 224. Namely, the audio board 217 and the main board 210 areconnected to the vehicle interface 224. A hands free 225 a for inputtinga voice signal, an airbag 225 b configured for the security of apassenger, a speed sensor 225 c for detecting the speed of the vehicle,or the like, may be connected to the vehicle interface 224. The speedsensor 225 c calculates a vehicle speed and provides the calculatedvehicle speed information to the CPU 212.

The navigation session 300 applied to the image display device 200generates road guidance information based on the map data and currentlocation information of the vehicle and provides the generated roadguidance information to the user.

The display unit 201 detects a proximity touch within a display windowvia a proximity sensor. For example, when a pointer (e.g., user's fingeror stylus) is proximity-touched, the display unit 201 detects theposition of the proximity touch and outputs position informationcorresponding to the detected position to the controller 212.

A voice recognition device (or a voice recognition module) 301recognizes a voice pronounced by the user and performs a correspondingfunction according to the recognized voice signal.

The navigation session 300 applied to the image display device 200displays a travel route on the map data, and when the mobile terminal100 is located within a pre-set distance from a blind spot included inthe travel route, the navigation session 300 automatically forms awireless network together with a terminal (e.g., a vehicle navigationapparatus) mounted in a nearby vehicle or a mobile communicationterminal carried around by a nearby pedestrian via radio communication(e.g., a short-range wireless communication network) to receive locationinformation of a nearby vehicle from the terminal mounted in the nearbyvehicle and receive location information of the nearby pedestrian fromthe mobile communication terminal carried around by the nearbypedestrian.

Meanwhile, the main board may be connected to the interface unit 230.The interface unit 230 includes an external device interface unit 231and a network interface 232.

The external device interface unit 231 may connect an external deviceand the image display device 200. To this end, the external deviceinterface unit 231 may include an A/V input/output unit (not shown) or awireless communication unit (not shown).

The external device interface unit 231 may be connected to an externaldevice such as a DVD (Digital Versatile Disk), Blu-ray, a game machine,a camera, a camcorder, a computer (or a notebook computer), and thelike, through a fixed line or wirelessly. The external device interfaceunit 231 may deliver an image, voice, or data signal input from theexterior through the connected external device to the controller 212 ofthe image display device 200. Also, the external device interface unit231 may output the image, voice, or data signal processed by thecontroller 212 to the connected external device. To this end, theexternal device interface unit 231 may include an A/V output unit (notshown) or a wireless communication unit (not shown).

The A/V input/output unit may include a USB terminal, a CVBS (CompositeMoving image Banking Sync) terminal, a component terminal, an S-movingimage terminal (analog), a DVI (Digital Visual Interface) terminal, anHDMI (High Definition Multimedia Interface) terminal, an RGB terminal, aD-SUB terminal, or the like, in order to input the image and voicesignal of the external device to the image display device 200.

The wireless communication unit may perform short-range radiocommunication with a different electronic device. The image displaydevice 200 may be connected to the different electronic device by anetwork according to a communication standard such as Bluetooth™, RFID(Radio Frequency Identification), IrDA (Infrared Data Association), UWB(Ultra Wideband), ZigBee™, DLNA (Digital Living Network Alliance), orthe like.

Also, the external device interface unit 231 may be connected to variousset-top boxes (STB) through at least one of and various terminals toperform an input or output operation with the STB.

Meanwhile, the external device interface unit 231 may receive anapplication or an application list from an adjacent external device andtransfer the same to the controller 212 or the memory 213.

The network interface unit 232 provides an interface for connecting theimage display device 200 to a wired/wireless network including theInternet. The network interface unit 232 may include, for example, anEthernet terminal for a connection with the wired network, and may use acommunication standard such as a wireless local area network (WLAN),wireless broadband (WiBro), world interoperability for microwave access(WiMAX), high speed downlink packet access (HSDPA), and the like, for aconnection with the wireless network.

The network interface unit 232 may transmit or receive data to or from adifferent user or a different electronic device through a connectednetwork or a different network linked to the connected network. Inparticular, a portion of contents data stored in the image displaydevice 200 may be transmitted to a user or an electronic device selectedfrom among different users or different electronic devices registered tothe image display device 200.

Meanwhile, the network interface unit 232 may be connected to a certainweb page through a connected network or a different network linked tothe connected network. Namely, the network interface unit 232 may beconnected to a certain Web page through a network to transmit or receivedata to or from the corresponding server. Besides, the network interfaceunit 232 may receive contents or data provided by a contents provider ora network operator. Namely, the network interface unit 232 may receivecontents such as movie, advertisements, games, VOID, a broadcast signal,or the like, provided from the contents provider or the networkprovider, and relevant information. Also, the network interface unit 232may receive update information and an update file of firmware providedby a network operator. Also, the network interface unit 232 may transmitdata to the contents provider or the network operator via the Internet.

Also, the network interface unit 232 may selectively receive anapplication among applications open to the public through a network.

FIG. 4A is a schematic block diagram of the image display deviceaccording to an exemplary embodiment of the present disclosure.

As shown in FIG. 4A, the image display device 200 may include acontroller 212, an interface unit 230, a display unit 201, or the like.Also, the image display device 200 may further include a memory 213. Thecomponents illustrated in FIG. 4A are illustrated for the sake ofconvenience of explanation, and the plurality of components illustratedin FIG. 3 may correspond to one of the components illustrated in FIG.4A, and the function of one component illustrated in FIG. 3 may beseparated to be implemented in the components illustrated in FIG. 4.

Also, all the components of the image display device 200 illustrated inFIG. 4A are not essential, and the image display device may beimplemented by more components or less components than those illustratedin FIG. 4A.

The controller 212 performs various functions according to an exemplaryembodiment of the present disclosure. In an exemplary embodiment of thepresent disclosure, the controller 212 basically controls the displayunit 201 to display an image received by the interface unit 230.

Also, in an exemplary embodiment of the present disclosure, thecontroller 212 may serve to detect image characteristic information fromthe received image. Also, the controller 212 may extract a particulararea on the basis of the detected image characteristic information.Hereinafter, the extracted particular area will be referred to as afirst area. The image characteristic information may be a moving image,a still image, or text.

In an exemplary embodiment of the present disclosure, the controller 212may determine an image processing scheme with respect to the first area.Determining of the image processing scheme by the controller 212 maymean that the controller 212 applies a predetermined image processingscheme. Thus, determining the image processing scheme by the controller212 and processing the first area accordingly may mean that thecontroller 212 processes the first area on the basis of thepredetermined image processing scheme.

Also, in an exemplary embodiment of the present disclosure, the imageprocessing scheme may be a scaling scheme with respect to a display sizeof the extracted area. For example, the scaling scheme may be a schemeof magnifying or reducing the first area to have a certain size. Thecertain size may be a predetermined size or may be determined accordingto an operator's selection (or a user selection).

Also, in an exemplary embodiment of the present disclosure, the imageprocessing scheme may be a scheme of changing the resolution of an imagecorresponding to the extracted area. For example, when the imagecorresponding to the extracted area is magnified, the controller 212 mayincrease the resolution to better the picture quality of the image.

Also, in an exemplary embodiment of the present disclosure, the imageprocessing scheme may be a scheme of processing the image with respectto the first area while the image display device 200 is communicatingwith the mobile terminal 100. For example, the image display device 200may receive a scaled-up or scaled-down image from the mobile terminaland display the received image on the display unit 201.

Also, in an exemplary embodiment of the present disclosure, the imageprocessing scheme may be a scheme of receiving only the image withrespect to the first area of the entire area from the mobile terminal100 and display the received image. For example, when the imagecharacteristic information is a moving image, only an imagecorresponding to the first area of the entire area is received to reducenetwork traffic. The receiving of only the image corresponding to thefirst area of the entire area may be implemented by requesting themobile terminal 100 to stop transmission of the other area than thefirst area. Here, the area other than the first area will be referred toas a second area.

Also, in an exemplary embodiment of the present disclosure, the imageprocessing scheme may be a scheme of replacing the image with respect tothe first area with a substitute image. For example, when the status ofthe vehicle corresponds with travel regulation conditions, the imagewith respect to the first area may be changed into a substitute image.This may be to lock out a display image with respect to the first areain order to prevent the driver from running when the status of thevehicle corresponds with the travel regulation conditions. For example,the travel regulation conditions may be that the status of the vehicleis a predetermined speed or faster. For example, the predetermined speedmay be five miles (8 kilometers) an hour.

Also, in an exemplary embodiment of the present disclosure, the imageprocessing scheme may be a scheme of extracting the size of text, whenthe image characteristic information is text, comparing the extractedsize with a reference size, and magnifying or reducing the first area onthe basis of the comparison results to display the magnified or reducedfirst area. Also, the controller 212 may process the first area on thebasis of the determined image processing scheme. Various imageprocessing schemes and travel regulation conditions are applied to anembodiment of the present disclosure.

The interface unit 230 may serve to communicate with an external device.For example, the external device may be the mobile terminal 100connected to the image display device 200 wirelessly or through a fixedline. The communication unit 100 may receive an image corresponding to acertain application from the mobile terminal 100. The received image mayinclude a moving image, a still image, text, or the like.

Also, the interface unit 230 may transmit a certain control signalgenerated by the controller to the mobile terminal 100. For example, thecertain control signal may be a control signal for requesting an imageobtained by magnifying or reducing the first image to a predeterminedsize.

The display unit 201 may serve to display the image received by theinterface unit 230. Also, the controller 212 may display the imagestored in the memory 213. The display unit 201 is controlled by thecontroller 212.

The memory 213 may serve to store the image received by the interfaceunit 230.

Also, the memory 213 may store the image processed on the basis of theimage processing scheme by the controller 212. For example, the memory213 may store image corresponding to the second area, which has beenrequested to be stopped, in the received image.

FIG. 4B is a flow chart illustrating the process of controlling anoperation of the image display device according to an exemplaryembodiment of the present disclosure. The method of FIG. 4B may beperformed by the devices shown in FIGS. 1-4A.

The interface unit 230 may receive an image from the mobile terminal 100connected to the image display device 200 wirelessly or through a fixedline (S110). For example, the interface unit 230 may receive a framebuffer including values with respect to all the pixels to be displayedon the screen of the mobile terminal 100 from the mobile terminal 100.

The image may be an image corresponding to the screen of the mobileterminal 100. For example, the image may be a standby screen image or alocked screen image of the mobile terminal, an image corresponding to anapplication being executed in the mobile terminal 100, or the like.

The controller 212 may detect image characteristic information from thereceived image (S120). Also, the controller 212 may extract (or select)a first area on the basis of the detected image characteristicinformation (S130). For example, the image characteristic informationmay be a moving image, a still image, text, or the like.

In an exemplary embodiment of the present disclosure, the imagecharacteristic information may be a moving image. In this case, theremay be various methods for detecting the moving image area.

Also, in an exemplary embodiment of the present disclosure, thecontroller 212 may detect a variation between a previously receivedimage and a currently received image, and compare the variation with athreshold variation. When the variation of the received image is greaterthan the threshold variation, the controller 212 may determine that theimage is a moving image.

Also, in an exemplary embodiment of the present disclosure, thecontroller 212 may use a motion vector in order to determine whether ornot the received image is a moving image. The motion vector is toestimate a motion of a moving image signal. As a general method fordetecting the motion vector, there is a block matching algorithm, inwhich an image signal is divided into blocks having a certain size, andthen a vector having the difference of a minimum average absolute valuecorresponding to each block or having a minimum average square errorvalue is obtained. Various other moving image detection methods can beapplied to an embodiment of the present disclosure.

The controller 212 may determine an image processing scheme with respectto the first area (step S140). The determining of the image processingscheme by the controller 212 may mean that the controller 212 applies apredetermined image processing scheme.

In an exemplary embodiment of the present disclosure, the imageprocessing scheme may be a scaling scheme with respect to a display sizeof the extracted area.

Also, in an exemplary embodiment of the present disclosure, the imageprocessing scheme may be a scheme of processing an image with respect tothe first area while the image display device 200 is communicating withthe mobile terminal 100.

Also, in an exemplary embodiment of the present disclosure, the imageprocessing scheme may be a scheme of receiving only the image withrespect to the first area of the entire area from the mobile terminal100 and display the received image.

Also, in an exemplary embodiment of the present disclosure, the imageprocessing scheme may be a scheme of replacing the image with respect tothe first area with a substitute image.

Also, in an exemplary embodiment of the present disclosure, the imageprocessing scheme may be a scheme of extracting the size of text, whenthe image characteristic information is text, comparing the extractedsize with a reference size, and magnifying or reducing the first area onthe basis of the comparison results to display the magnified or reducedfirst area. Various image processing schemes and travel regulationconditions are applied to an embodiment of the present disclosure.

The controller 212 may process the extracted first area on the basis ofthe determined image processing scheme (step S150). In an exemplaryembodiment, the controller 212 may determine whether or not a currentstatus of the vehicle corresponds with the travel regulation conditions,and determine whether to process the extracted first area on the basisof the determined image processing scheme. For example, the controller212 may magnify and display the first area until when the speed of thevehicle is 5 miles an hour or greater.

Also, in an exemplary embodiment of the present disclosure, thecontroller 212 may provide guide information to allow the driver of thevehicle to select whether to process the extracted first area on thebasis of the determined image processing scheme. For example, the guideinformation may be voice information. Also, the guide information may beprovided through various UIs (User Interfaces).

The controller 212 may control the display unit 201 to display theprocessed first area (step S140). In an exemplary embodiment of thepresent disclosure, the guide information may be displayed on thedisplay unit 201 or may be output by voice.

First Embodiment

FIG. 5A is a view showing the process of controlling an operation of theimage display device according to a first exemplary embodiment of thepresent disclosure.

With reference to FIG. 5A, an image (the entire area 400) received fromthe mobile terminal 100 is displayed by the image display device 200(See FIG. 5A(a)). The received image (the entire area 400) may includeimage characteristic information. The image characteristic informationmay be a moving image, a still image, text, or the like. The receivedimage (the entire area 400) in FIG. 5A includes a moving image area (afirst area 410) and a still image area (a second area 420).

The controller 212 may detect the area (first area 410), including themoving image, from the entire area 400. The extracted first area 430 isillustrated in FIG. 5A(b). The moving image, whose images changes overtime, may be detected through various methods.

In the firstexemplary embodiment of the present disclosure, thecontroller 212 may detect a variation between a previously receivedimage and a currently received image, and compare the variation with athreshold variation. When the variation of the received image is greaterthan the threshold variation, the controller 212 may determine that theimage is a moving image. Various moving image detection methods may beapplicable to the first embodiment of the present disclosure.

The controller 212 may determine an image processing scheme with respectto the extracted area as described above. In FIG. 5A(a), the imageprocessing scheme is a scheme for magnifying the first area 410 to havea predetermined size and for displaying the same. A portion of an area(second area 420), excluding the moving image part, may not be displayedon the screen due to the magnified first area 410.

In the firstexemplary embodiment of the present disclosure, the imageprocessing scheme may be a scheme of magnifying the first area 410 tohave a predetermined size and changing the resolution of the imagecorresponding to the extracted area.

In the firstexemplary embodiment of the present disclosure, theprocessing of the first area 410 on the basis of the image processingscheme may be performed only when the current status of the vehiclecorresponds with the travel regulation conditions. For example, thetravel regulation conditions may be a case in which a current speed ofthe vehicle corresponds to a predetermined speed or faster. The travelregulation conditions may aim at preventing the driver from beinginterfered with while he is driving.

In the firstexemplary embodiment of the present disclosure, thecontroller 212 may provide guide information to allow the operator (orthe user) to determine whether to execute the image processing scheme inapplying the image processing scheme. For example, the guide informationmay be provided through a UI. Also, the guide information may be outputby voice by the image display device 200.

Also, in the firstexemplary embodiment of the present disclosure, theimage display device 200 may receive an image obtained by magnifying thefirst area 410 from the mobile terminal 100. For example, the controller212 may detect the first area 410 including the moving image andtransmit a control signal for requesting an image obtained by magnifyingthe first area 410 to the mobile terminal 100. When the mobile terminal100 transmits an image obtained by magnifying the first area 410 to havea predetermined resolution in response to the control signal, the imagedisplay device 200 may receive the image through the interface unit 230.When the image display device 200 receives the magnified image withrespect to the first area 410 from the mobile terminal 100, the imagedisplay device 200 may display an image having better picture quality.

FIGS. 5B and 5C are flow charts illustrating the process of controllingan operation of the image display device according to the firstexemplary embodiment of the present disclosure. The methods of FIGS. 5Band 5C may be performed by the devices shown in FIGS. 1-4A.

With reference to FIG. 5B, the interface unit 230 may receive an imagefrom the mobile terminal 100 (step S210). The controller 212 may detectan area (first area 410) including a moving image from the receivedimage (step S220). Also, the controller 212 may magnify the first area410 (step S230). The display unit 201 may display the magnified image(step S240).

With reference to FIG. 5C, the image display device 200 may receive animage from the mobile terminal 100 through the interface unit 230 (stepS310). The controller 212 may detect the area (first area 410) includingthe moving image from the received image (step S320). Also, thecontroller 212 may request the mobile terminal to transmit an imageobtained by magnifying the first area 410 to have a predeterminedresolution (step S330). When the mobile terminal 100 transmits the imagewhich has been magnified to have a predetermined resolution in responseto the request, the image display device 200 may receive the magnifiedimage through the interface unit 230 (step S340). The display unit 201may display the received image (step S350).

Second Embodiment

FIG. 6 is a flow chart illustrating the process of controlling anoperation of the image display device according to a second exemplaryembodiment of the present disclosure. The method of FIG. 6 may beperformed by the devices shown in FIGS. 1-4A.

With reference to FIG. 6, the image display device may receive an imagefrom the mobile terminal 100 through the interface unit 230 (step S410).The received image (the entire area 400) may include items of imagecharacteristic information. For example, the entire area 400 may includea moving image and a still image.

The controller 212 may extract an area (a first area 410) including amoving image and an area (a second area 420) including a still image(step S420).

In the second exemplary embodiment of the present disclosure, thecontroller 212 may detect the first area 410 and extract a remainingarea, excluding the first area 410, of the received image, as a secondarea 420.

Also, in the second exemplary embodiment of the present disclosure, thecontroller 212 may detect the still image and divide the image into thefirst area 410 and the second area 420. Various methods for extractingthe first area 410 and the second area 420 may be applicable to anembodiment of the present disclosure.

Also, in the second exemplary embodiment of the present disclosure, thesecond area 420 does not change over time, so the image display device200 may receive only the image corresponding to the first area 410 ofthe entire area 400 from the mobile terminal 100, thus reducing thenetwork traffic.

Accordingly, the controller 212 may request a continuous transmission ofthe image with respect to the first area 410 from the mobile terminal100 (step S430). IN this case, the interface unit 230 may receive animage in response to the request from the mobile terminal 100 (stepS450).

Also, in the second exemplary embodiment of the present disclosure, inorder for the interface unit 230 to receive only the image with respectto the first area 410 of the entire area 400 from the mobile terminal100, interruption of the transmission of the image with respect to thesecond area 420 may be requested from the mobile terminal 100.

Also, in the second exemplary embodiment of the present disclosure, thecontroller 212 may store the image with respect to the second area 420in the memory 212 (step S440). The controller 212 may control thedisplay unit 201 to display the image with respect to the first area 410and the image with respect to the second area 420 (step S460).

Also, in the second exemplary embodiment of the present disclosure, thecontroller 212 may receive only the image with respect to the first area410 of the entire area 400 from the mobile terminal 100 on the basis ofa certain reference. For example, the certain reference may be a case inwhich the image corresponding to the first area 410 uniformly changesduring a time interval of a threshold time or greater.

Also, in the second exemplary embodiment of the present disclosure, thecontroller 212 may periodically check a temporal variation of the imagewith respect to the first area 410. As a result, the controller 212 maycontrol the interface unit 230 to receive only the image with respect tothe first area 410 of the entire area 400 only when the imagecorresponding to the first area 410 corresponds with the certainreference, thus effectively processing the image corresponding to thefirst area 410.

Also, in the second exemplary embodiment of the present disclosure, thecontroller 212 may periodically determine whether to process thereceived image on the basis of the image processing scheme. For example,the controller 212 may periodically check a change in the state of theimage with respect to the first area 410 or the second area 420 anddetermine whether to process the received image on the basis of theimage processing scheme.

Also, in the second exemplary embodiment of the present disclosure, whena change in the image with respect to the first area 410 or the secondarea 420 is detected, the controller 212 may determine whether toprocess the received image on the basis of the image processing scheme.Such an operation of the controller 212 may serves to increase theefficiency of the image processing scheme.

Third Embodiment

FIG. 7A is a view showing the process of controlling an operation of theimage display device according to a third exemplary embodiment of thepresent disclosure. The process of FIG. 7A may be performed by thedevices shown in FIGS. 1-4A.

With reference to FIG. 7A, the controller may extract the area (thefirst area 410) including the moving image (See FIG. 7A(a)). Theextracted first area 430 is displayed in FIG. 7A(b).

In the third exemplary embodiment of the present disclosure, in order toprevent the driver (or user) from being interfered with while he isdriving, a certain travel regulation may be made. For example, when thespeed of the vehicle is a certain speed (e.g., five miles (8 kilometers)an hour) or higher, the controller 212 may lock out the moving imagearea to prevent the driver from viewing the moving image.

For example, the controller 212 may use the speed sensed by the speedsensor 225 c as the speed of the vehicle. Also, the controller 212 maycalculate a location variation (or distance) per unit hour by usinglocation information received from the GPS module 207 to recognize thespeed of the vehicle. Various speed detection methods can be applicableto an embodiment of the present disclosure.

Thus, the controller 212 may determine whether the status of the vehiclecorresponds with the travel regulation conditions, and change the imagewith respect to the first area 410 with a substitute image 440 on thebasis of the determination results. The changing into the substituteimage 440 may serves as the lock-out.

The substitute image 440 may be a certain image in a broad sense inorder to prevent the driver (or user) from being interfered with whilehe is driving. For example, the substitute image 440 may be a full imagein black. Also, the substitute image 440 may include an X shape formedby two diagonal straight lines. Various substitute images can beapplicable to an embodiment of the present disclosure.

Various travel regulation conditions can be applicable to an embodimentof the present disclosure.

FIG. 7B is a flow chart illustrating the process of controlling anoperation of the image display device according to the third exemplaryembodiment of the present disclosure.

With reference to FIG. 7B, the image display device 200 may receive animage from the mobile terminal 100 through the interface unit 230 (stepS510). The controller 212 may extract the area (first area 410)including a moving image from the received image (step S520).

In the third exemplary embodiment of the present disclosure, thecontroller 212 may determine whether or not the status of the vehiclecorresponds with the travel regulation conditions (step S530). When thestatus of the vehicle corresponds with the travel regulation conditions,the controller 212 may change the image corresponding to the first imagewith a substitute image 440 on the basis of the determination results(step S540).

When the image corresponding to the first area 410 is changed to thesubstitute image 440 or when the status of the vehicle does notcorrespond with the travel regulation conditions, the controllingprocess of the operation of the image display device 200 is terminated.

Fourth Embodiment

FIG. 8A is a view showing a process of controlling an operation of theimage display device according to a fourth exemplary embodiment of thepresent disclosure. The process of FIG. 8A may be performed by thedevices shown in FIGS. 1-4A.

With reference to FIG. 8A, the controller 212 may extract an area(second area 420) including text. The extracted second area 450 isillustrated in FIG. 8A(b).

In the fourth exemplary embodiment of the present disclosure, there maybe various methods for extracting the area including the text. Forexample, the controller 212 may extract a text vector to recognize theshape of the text and compare the text vector with a reference vector todetect whether or not a particular area includes text. Alternatively,the controller 212 may extract the area based on a user selection, suchas a touch or drag to the touch screen.

Also, there may be various schemes for detecting text of a particulararea. In the fourth exemplary embodiment, there may be an opticalcharacter recognition (OCR), a technique for automatically recognizingtext included in a document. Various schemes for detecting an areaincluding text may be applicable to an embodiment of the presentdisclosure.

Also, in the fourth exemplary embodiment of the present disclosure, whenthe second area 420 is extracted, the controller 212 extracts the sizeof the text included in the second area 420. The size of the text may bea size of the shape of a letter in a broad sense. Thus, the size of thetext may be a size of the font. Also, the size of the text may indicatethe size of the area including the text.

The detection of the size of the text may be similar to a scheme ofextracting the second area 420, and the text may be extracted in theprocess of extracting the second area 420. Various schemes of detectingthe size of the text can be applicable to an embodiment of the presentdisclosure.

Also, in the fourth exemplary embodiment of the present disclosure, thecontroller 212 may compare the detected size of the text with areference size.

Also, in the fourth exemplary embodiment of the present disclosure, thecontroller 212 may control the display unit 201 to magnify or reduce thesecond area 420 and display the same. For example, when the extractedsize of the text is smaller than the reference size, the controller 212may magnify the second area 420 to have a predetermined size. Also, inan exemplary embodiment of the present disclosure, the controller 212may change the image with respect to the second area to have apredetermined resolution and may change the image to have apredetermined resolution when the size of the text is magnified to havea predetermined size.

In FIG. 8A, the size of the text included in the second area 420 issmaller than the reference size, so the second area 420 is magnified(FIG. 8A(c)).

FIG. 8B is a flow chart illustrating the process for controlling anoperation of the image display device according to the fourth exemplaryembodiment of the present disclosure. The method of FIG. 8B may beperformed by the devices shown in FIGS. 1-4A.

With reference to FIG. 8B, the image display device 200 may receive animage from the mobile terminal 100 thorough the interface unit 230 (stepS610). The controller 212 may detect an area (second area 420) includingtext from the received image (step S620).

In the fourth exemplary embodiment of the present disclosure, thecontroller 212 may extract the size of the text in the detected secondarea 420. Also, the controller 212 may compare the extracted size of thetext with a reference size (step S640).

Also, in the fourth exemplary embodiment of the present disclosure, whenthe extracted size of the text is smaller than the reference size on thebasis of the comparison results, the controller 212 may magnify thesecond area 420 to have a predetermined size (step S650). When thesecond area 420 is magnified or when the extracted size of the text isgreater than the reference size, the process for controlling theoperation of the image display device 200 is terminated. Besides, whenthe extracted size of the text is greater than the reference size, theprocess of controlling the operation of the image display device 200 forreducing the second area 420 can be applicable to an embodiment of thepresent disclosure.

Also, in the fourth exemplary embodiment of the present disclosure, whenthe extracted size of the text is smaller than a first reference size,the controller 212 magnifies the second area 420, and when the extractedsize of the text is greater than a second reference size, the controller212 may reduce the second area 420.

Also, in the fourth exemplary embodiment of the present disclosure, thefirst and second reference sizes may be set to have different values.The process of controlling the operation of the image display deviceusing various text comparing methods and scaling schemes is applicableto an embodiment of the present disclosure.

Fifth Embodiment

FIG. 9 is a view showing a process of controlling an operation of themobile terminal according to a fifth exemplary embodiment of the presentdisclosure. The process of FIG. 9 may be performed by the devices shownin FIGS. 1-4A.

With reference to FIG. 9, a first image display device 200 receives animage from the mobile terminal 100 that is connected through a fixedline or wirelessly and display the received image on its screen.

In the fifth exemplary embodiment, the image may be displayed on thescreen by a second image display device 500 installed at a differentposition (or other seat) in the vehicle.

Also, in the fifth exemplary embodiment of the present disclosure, themulti-screen function may be implemented, for example, by an N-screen.The N-screen refers to a system of using a common service by variousterminals (e.g., a table PC, a notebook computer, a smartphone, or thelike) equipped with a common operating system.

In the fifth exemplary embodiment, when the mobile terminal 100 isconnected to the first image display device 200 and a certainapplication is being executed, the first image display device 200 andthe second image display device 500 may display an image related to theexecution of the application.

In general, when the mobile terminal 100 receives an incoming call whileexecuting the application, the screen of the mobile terminal 100 may bechanged to a call screen.

However, in the fifth exemplary embodiment of the present disclosure,when the mobile terminal 100 is connected to the first image displaydevice, although the mobile terminal 100 receives the incoming call, themobile terminal 100 can continuously display the image with respect tothe executed application.

In the fifth exemplary embodiment, the second image display device 500can continuously display the image with respect to the application, andcontinuously controls the operation of the mobile terminal.

Also, in the fifth exemplary embodiment of the present disclosure, thecontroller 180 of the mobile terminal 100 may control the communicationunit to transmit a signal indicating that the incoming call has beenreceived to the image display device mounted in the vehicle. When themobile terminal 100 receives the incoming call, the image of the firstimage display device 200 may be changed to a hands free screen image.

Sixth Embodiment

FIG. 10 is a flow chart illustrating the process of controlling anoperation of the image display device according to a sixth exemplaryembodiment of the present disclosure. The method of FIG. 10 may beperformed by the devices shown in FIGS. 1-4A.

In the sixth exemplary embodiment of the present invention, thecontroller 212 may determine whether or not the type of the applicationbeing executed in the process of controlling the operation of the imagedisplay device 200 is a travel regulation target.

Also, in the sixth exemplary embodiment of the present disclosure, whenthe application is a travel regulation target on the basis of thedetermination results, the controller 212 may change the image receivedfrom the mobile terminal 100 to a substitute image.

For example, when the image with respect to the application beingexecuted is a moving image related to movie, since the moving image havea possibility of interfering with the driver (user) who is driving, thecontroller 212 may change the moving image to a substitute image. Forexample, when the application being executed is a navigationapplication, since the image is not a travel regulation target, thecontroller may continuously display the image with respect to theapplication.

Also, in the sixth exemplary embodiment of the present disclosure, indetermining whether or not the application being executed is a travelregulation target, the controller 212 may determine whether or not theapplication being executed is a travel regulation target on the basis ofa classification model with respect to the application.

Also, in the sixth exemplary embodiment of the present disclosure, theclassification model may be used as an index for determining whether ornot to which application the image currently received form the mobileterminal 100 corresponds.

Also, in the sixth exemplary embodiment of the present disclosure, theindex may be a sort of function in which certain information is inputand results obtained by discriminating the type of the application areoutput.

Also, in the sixth exemplary embodiment of the present disclosure, thesort of function may be a certain mathematical model. Fro example, thecertain mathematical model may be an n-dimensional equation. Variousclassification models for determining the type of the application isapplicable to an embodiment of the present disclosure.

Also, in the sixth exemplary embodiment of the present disclosure, ingenerating the classification mode, a machine learning algorithm may beused.

Also, in the sixth exemplary embodiment of the present disclosure, theclassification model may be generated on the basis of certain learningdata, and in detail, image characteristic information may be extractedfrom the learning data and the machine learning algorithm is performedby using the image characteristic information.

Also, in the sixth exemplary embodiment of the present disclosure, inorder to determine whether or not the application is a navigationapplication, the controller 212 may collect image data of various typesof navigation applications. The collected image data may be learningdata.

Also, in the sixth exemplary embodiment of the present disclosure, theimage characteristic information may be the color of a road, the numberof straight lines, the color and shape information of road guidemilestone, or the like.

Also, in the sixth exemplary embodiment of the present disclosure, whenthe image characteristic information is determined, since an outputemploying the classification model is a navigation output, amathematical model for determining the type of the application beingexecuted may be generated by using the image characteristic information.

Known as the machine learning algorithm includes an SVM (Support VectorMachine), an ANN (Artificial Neutral Network), or the like.

The SVM refers to a map learning method using a statisticsclassification and regression analysis. SVM applies a technique of alinear classification to a nonlinear classification problem by using akernel trick.

The SVM refers to one of learning models having the most excellentrecognition performance among the numerous schemes known so far. Thereason for the SVM to exhibit the excellent recognition performance isbecause SVM includes a scheme for obtaining a high recognitionperformance with respect to non-learning data.

The SVM is uses a linear threshold element and configures a 2-classpattern recognizer. A parameter of a linear threshold element is learnedon the basis of the reference called a margin maximization from atraining sample.

The ANN is a mathematical model aiming at expressing the somecharacteristics of a brain function by a computer simulation. ANN isalso called a neural network, and when ANN is strictly discriminatedfrom biology or a brain science, ‘artificial’ is attached in front ofthe acronym.

The ANN generally refers to a model having a problem solving capabilityby changing a coupling strength of synapses through learning of anartificial neuron (node) forming a network by coupling the synapses. Ina narrow sense, the ANN may indicate a multi-layer perception using anerror back-propagation method, but the ANN is not limited thereto.

The ANN includes supervised learning optimized for a problem byinputting a supervising signal (correct answer) and unsupervisedlearning which does not require a supervising signal. When there is aclear solution, the supervised learning is used, and the unsupervisedlearning is used for data clustering. Resultantly, in order to reduceevery dimension, a good reply may be obtained with a relatively smallamount of calculation with respect to a problem which cannot be linearlyseparated, by multi-dimensional data such as an image, statistics, orthe like. Thus, ANN is applied in various fields, such as a patternrecognition, data mining, or the like.

Also, in the sixth exemplary embodiment of the present disclosure, thecontroller 212 determines the type of an application being currentlyexecute on the basis of the classification model.

Also, in the sixth exemplary embodiment of the present disclosure, thecontroller 212 extracts the image characteristic information from theimage received from the mobile terminal 100. In this case, thecontroller 212 inputs the image characteristic information to theclassification mode.

Also, in the sixth exemplary embodiment of the present disclosure, thecontroller 212 determines the type of an application with a certainvalue obtained from the mathematical model by inputting the imagecharacteristic information to the mathematical model included in theclassification model. When the type of the application is a travelregulation target according to the result of the application to theclassification model, the controller 212 may change the received imageto the substitute image, and in this case, the controller 212continuously displays the received image.

Also, in the sixth exemplary embodiment of the present disclosure, thecontroller 212 may perform the process of controlling the operation ofthe image display device 200 on the basis of the predeterminedclassification mode.

Also, in the sixth exemplary embodiment of the present disclosure, thepredetermined classification mode may be obtained in advance through themachine learning algorithm and stored in the memory 213 of the imagedisplay device 200.

Also, in the sixth exemplary embodiment of the present disclosure, thecontroller 212 may perform the process of controlling the operation ofthe image display device 200 on the basis of the classification modelwhich is continuously updated while the image display device 200 isoperating.

Another method for updating a classification mode is an incrementallearning algorithm.

Also, in the sixth exemplary embodiment of the present disclosure,although the application being executed is navigation when the imagedisplay device 200 determines that the application is a travelregulation target and changes the received image to a substitute image,the driver (or user) may input information indicating that theapplication is navigation to the image display device. The controllermay correct the classification model and may control the image displaydevice 200 to be properly operated.

With reference to FIG. 10B, the image display device 200 may receive animage from the mobile terminal 100 through the interface unit 230 (stepS710). The controller 212 may extract image characteristic informationfrom the received image (step S720).

The controller 212 may apply the extracted image characteristicinformation to a classification model (step S730). The controller maydetermine whether or not the application corresponding to the receivedimage a travel regulation target on the basis of the application results(step S740).

When the application is a travel regulation target, the controller 212may change the received image to a substitute image 440 (step S750).When the received image is changed to the substitute image 440 or whenthe application odes not correspond with the travel regulationconditions, the process of controlling the operation of the imagedisplay device 200 is terminated.

Meanwhile, the method for controlling the operation of the image displaydevice according to an exemplary embodiment of the present disclosurecan be implemented as codes that can be read by a processor in aprogram-recorded medium. The processor-readable recording medium mayinclude a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, anoptical data storage device, and the like. The processor-readablerecording medium also includes implementations in the form of carrierwaves or signals (e.g., transmission via the Internet). Also, codeswhich are distributed in computer devices connected by a network and canbe read by a computer in a distributed manner are stored and executed inthe processor-readable recording medium.

As the exemplary embodiments may be implemented in several forms withoutdeparting from the characteristics thereof, it should also be understoodthat the above-described embodiments are not limited by any of thedetails of the foregoing description, unless otherwise specified, butrather should be construed broadly within its scope as defined in theappended claims. Therefore, various changes and modifications that fallwithin the scope of the claims, or equivalents of such scope aretherefore intended to be embraced by the appended claims.

What is claimed is:
 1. A display system configured to be installed in avehicle, the display system comprising: a display unit; a communicationunit; and a processor operatively connected to the display unit and thecommunication unit, the processor configured to display a screen of datareceived from an application, detect that the received screen includesat least one of a first area containing moving images and a second areacontaining a static image, and determine a speed of the vehicle, andbased on the determined speed, change a display characteristic of thedetected at least one of the first area and the second area.
 2. Thedisplay system of claim 1, wherein, when the determined speed crosses apredetermined speed threshold, the processor is configured to freeze themoving images, disable the first area, or overlay an image on the movingimages while continuing to display the static image in the second area.3. The display system of claim 1, wherein the processor is configured todetermine a type of the application, and when the determined speedcrosses a predetermined speed threshold, freeze the moving images,disable the first area, replace the moving images with a predeterminedimage, or overlay an image on the moving images, based on the determinedapplication type, while continuing to display the static image in thesecond area.
 4. The display system of claim 1, wherein, when thedetermined speed crosses a predetermined speed threshold in a firstdirection, the processor is configured to magnify the first area.
 5. Thedisplay system of claim 4, wherein, when the determined speed crossesthe predetermined speed threshold in a second direction opposite to thefirst direction, the processor is configured to reduce a size of themagnified first area.
 6. The display system of claim 1, wherein, whenthe determined speed crosses a predetermined speed threshold in a firstdirection, the processor is configured to compare a text size of aportion of the second area to a predetermined threshold, and magnify theportion of the second area if the text size of the received screen isbelow the predetermined threshold.
 7. The display system of claim 6,wherein, when the determined speed crosses the predetermined speedthreshold in a second direction opposite to the first direction, theprocessor is configured to reduce a size of the magnified portion of thesecond area.
 8. The display system of claim 6, wherein the processor isconfigured to select the portion of the second area based on one of atext vector configured to recognize a shape of the portion containingthe text and a user selection of the portion containing the text.
 9. Amethod for controlling a display installed in a vehicle, the methodcomprising: displaying, by the display, a screen of data received froman application, detecting, by the display, that the received screenincludes at least one of a first area containing moving images and asecond area containing a static image, and determining, by the displaysystem, a speed of the vehicle, and based on the determined speed,changing, by the display, a display characteristic of the detected atleast one of a first area and a second area.
 10. The method of claim 9,wherein, when the determined speed crosses a predetermined speedthreshold, the step of changing the display characteristic comprises:freezing the moving images, disabling the first area, replacing themoving images with a predetermined image, or overlaying an image on themoving images while continuing to display the static image in the secondarea.
 11. The method of claim 9, further comprising: determining a typeof the application, wherein, when the determined speed crosses apredetermined speed threshold, the step of changing the displaycharacteristic comprises: freezing the moving images, disabling thefirst area, replacing the moving images with a predetermined image, oroverlaying an image on the moving images, based on the determinedapplication type, while continuing to display the static image in thesecond area.
 12. The method of claim 9, wherein, when the determinedspeed crosses a predetermined speed threshold, the step of changing thedisplay characteristic comprises: magnifying the first area.
 13. Themethod of claim 12, further comprising: when the determined speedcrosses the predetermined speed threshold in a second direction oppositeto the first direction, reducing a size of the magnified first area. 14.The method of claim 9, wherein, when the determined speed crosses apredetermined speed threshold, the step of changing the displaycharacteristic comprises: comparing a text size of a portion of thesecond area to a predetermined threshold, and magnifying the portion ofthe second area if the text size of the received screen is below thepredetermined threshold.
 15. The method of claim 14, further comprising:when the determined speed crosses the predetermined speed threshold in asecond direction opposite to the first direction, reducing a size of themagnified portion of the second area.
 16. The method of claim 14,further comprising: selecting the portion based on one of a text vectorconfigured to recognize a shape of the portion containing the text and auser selection of the portion containing the text.